900731 Data Handling for Eye-in-the-Sea on MARS : Installing Condor As Master Node on Linux

This page last changed on Nov 07, 2012 by dcline.

Overview

The master node is the most important node in the Condor pool and should be the highest reliability machine. Do the following steps and user root:

Install

To install as the role manager and view server:

[root@nanomia condor]# /opt/condor-7.2.3/condor_configure --type=submit,execute,manager --central-manager=`hostname --long` --owner=aved --install-dir=/opt/condor-7.2.3

Edit /opt/condor-7.2.3/etc/condor_config changing the lines to allow READ/WRITE access and an address where email should be sent when something goes wrong
```
HOSTALLOW_WRITE = *.shore.mbari.org
CONDOR_ADMIN = dcline@mbari
MAIL = /bin/mail
```

Open the local configuration file /opt/condor-7.2.3/local.nanomia/condor_config.local. Many modifications are required, including modifing the DAEMON_LIST to include VIEW_SERVER, changing the START expression, and

POOL_HISTORY_DIR=$(RELEASE_DIR)/local.nanomia/poolhistory
KEEP_POOL_HISTORY=True
CONDOR_VIEW_HOST = $(CONDOR_HOST)
VIEW_SERVER=$(CONDOR_HOST):9619
VIEW_SERVER_LOG=$(RELEASE_DIR)/local.nanomia/viewserverlog
START = ( $(CPUIdle) || (State != "Unclaimed" && State != "Owner"))
UID_DOMAIN = $(FULL_HOSTNAME)
FILESYSTEM_DOMAIN = $(FULL_HOSTNAME)
TRUST_UID_DOMAIN = True
DEFAULT_DOMAIN_NAME = shore.mbari.org

View server directory setup

As user aved, create the necessary directories as defined in the configuration file. If anything goes wrong, a good reference for setting up the server https://www.lsc-group.phys.uwm.edu/lscdatagrid/doc/condorview.html.

[aved@nanomia condor] mkdir /opt/condor-7.2.3/local.nanomia/poolhistory
[aved@nanomia condor] mkdir /opt/condor-7.2.3/local.nanomia/viewserverlog

Setup view client

As user root,

Download view client module from here: http://www.cs.wisc.edu/condor/downloads/contrib.license.html

Uncompress into web served directory

[root@nanomia condor] mkdir /var/www/html/condor-view-applet
[root@nanomia condor] cd /var/www/html/condor-view-applet
[root@nanomia condor] cp <mydownloads>/view_client-2.0-Any-Java.tar.Z .
[root@nanomia condor] tar -zxvf view_client-2.0-Any-Java.tar.Z
[root@nanomia condor] tar -xvf view_client.tar

Edit make_stats, changing ORGNAME, CONDORADMIN, etc. to reflect the installation, then run
the installation
```
[root@nanomia condor] ./make_stats setup
[root@nanomia condor] crontab cronentries
```
The page should be visible http://nanomia.shore.mbari.org/condor-view-applet/condor/condorview/.
MBARI Mail setup

Condor can be configured to email to users on job completion, or failure. By default the root user will receive any emails if the condor daemons go awry. The following instructions are to setup the machine to correctly forward the emails. To send mail correctly to the MBARI exchange server, with the following:

Asssuming sendmail is installed, make sure sendmail-cf RPM is installed, and if not *you must install this first*

[root@nanomia condor]# yum install sendmail-cf

The /etc/mail/sendmail.mc File

Only a few things must be changed from the default sendmail configuration to work with the MBARI email server:

Add following line - this change allows sendmail to redirect to the MBARI mail server
```
define(`SMART_HOST',`mail.mbari.org')
```
Comment out the following line in /etc/mail/sendmail.mc. This change allows sendmail to receive mail from the Internet and not just the local loopback address. This is not necessary unless your condor is setup as a master, but a good idea if you ever want to test your condor as a master.
```
dnl DAEMON_OPTIONS(''Port=smtp,Addr=127.0.0.1,Name=MTA')dnl
```

The /etc/mail/virtusertable File

If your machine runs jobs as the user "aved", the account will need to be forwarded to a legitimate MBARI user, e.g. dclinembari.org. If you are running as a user other than aved, then skip this
```
aved@nanomia.shore.mbari.org:   @mbari.org
```
Otherwise, forward your mail to a legitimate MBARI user, e.g. dcline@mbari.org, by adding the following line:
```
dcline@nanomia.shore.mbari.org:  dcline@mbari.org
```

Restart sendmail

To reset sendmail with the changes in /etc/mail/sendmail.mc and /etc/mail/virtusertable restart the sendmail service

[root@nanomia mail]/sbin/service sendmail restart

Comments:

mail.mbari.org is now mbarimail.mbari.org

Posted by dcline at May 21, 2013 11:11

Document generated by Confluence on Feb 03, 2026 14:51